REMARKS 

The claims now pending in the appUcation are Claims 1 to 24, 30 to 32 and 
34 to 36, the independent claims being Claims 1, 8, 15, 30 to 32 and 34 to 36. Claims 25 
to 29, 33 and 37 have been cancelled herein. Claims 1 to 24, 30 to 32 and 34 to 36 have 
been amended herein. 

In the Official Action dated February 5, 2004, Claims 1 to 37 were rejected 
under 35 U.S.C. § 102(e), as anticipated by U.S. Patent No. 6,680,746 (Kawai). 
Reconsideration and withdrawal of the rejection respectfully are requested in view of the 
above amendments and the following remarks. 

The rejections of the claims over the cited art respectfully are traversed. 
Nevertheless, without conceding the propriety of the rejections, Claims 25 to 29, 33 and 37 
have been cancelled and Claims 1 to 24, 30 to 32 and 34 to 36 have been amended herein 
more clearly to recite various novel features of the present invention, with particular 
attention to the Examiner's comments. Support for the proposed amendments may be 
found in the original application. No new matter has been added. 

The present invention relates to a novel communication system. In one 
aspect, as now recited in independent Claim 1, the present invention relates to a 
communication apparatus which is connected to at least one camera and at least one 
monitor and manages information conceming a state of the at least one camera. The 
communication apparatus comprises a reception device that receives the information 
conceming the state of the at least one camera, and a transmission device that transmits the 
information conceming the state of the at least one camera received by the receiving 
device to the at least one monitor, so as to change a display conceming the state of the at 
least one camera displayed on the at least one monitor; in this aspect, when the state of any 
one of the at least one camera is changed, the transmission device transmits the information 
conceming the changed state of that camera to the at least one monitor via a network. 
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In a similar aspect, as now recited in independent Claim 8, the present 
invention relates to such a communication apparatus including a reception device and a 
transmission device, wherein, when a request (i.e., for update information) from the at least 
one monitor is received, the transmission device transmits the information to the at least 
monitor via the network. 

In another aspect, as now recited in independent Claim 15, the present 
invention relates to a communication apparatus which is connected to at least one camera 
and at least one monitor and manages information concerning a state of the at least one 
camera. The communication apparatus comprises a reception device that receives the 
information concerning the state of the at least one camera, a processing device that 
changes a display image conceming the state of the at least one camera displayed on the at 
least one monitor, in accordance with the received information conceming the state of the 
at least one camera, and a transmission device that transmits the display image conceming 
the state of the at least one camera processed by the processing device to the at least one 
monitor via a network. 

Independent Claims 30 to 32 and 34 to 36 respectively recite similar 
features with respect to a communication method and a communication medium which 
stores a computer-readable program of a control method for a communication apparatus 
which is connected to at least one camera and at least one monitor and manages 
information conceming a state of the at least one camera. 

With respect to independent Claims 1, 30 and 34, in each aspect, when the 
state of any one of the at least one camera is changed, the transmission device (or step) 
transmits the information conceming the changed state of that camera to the at least one 
monitor connected via a network. 
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With respect to independent Claims 8, 31 and 35, in each aspect, when a 
request (i.e., for update information) is received from a monitor, the transmission device 
(or step) transmits the information to the (at least one) monitor connected via the network. 

Applicants submit that the prior art fails to anticipate the present invention. 
Moreover, Applicants submit that there are differences between the subject matter sought 
to be patented and the prior art, such that the subject matter taken as a whole would not 
have been obvious to one of ordinary skill in the art at the time the invention was made. 

The Kawai '746 patent relates to an apparatus and method for controlling a 
configuration of a video camera, and discloses a camera control system for displaying a 
video image input from a plurality of cameras, and for preparing a map showing icons 
indicating the positions of the cameras on the map, so that the direction of the cameras can 
be identified on the map. However, Applicants submit that the Kawai '746 patent fails to 
disclose or suggest at least the above-described features of the present invention. Rather, 
the Kawai '746 patent discloses that, in a camera operation unit 20, the received 
information concerning the state of the at least one camera is transmitted to a bit-map 
display 28 provided in the camera operation unit 20 itself Li one aspect, as described 
above, the present invention transmits the entire information conceming the state of (each 
of) the at least one camera to (each of) the at least one monitor connected via the network. 
As discussed in greater detail in the present application, this aspect of the present invention 
provides a significant improvement over systems of the prior art, in that it provides a 
dynamic mapping of all cameras, as well as the overall status of each camera (including 
direction of video taking), to all monitors connected via the network. The Kawai '746 
patent is silent with respect to any operation that information is transmitted to such 
monitors when the state of a camera is changed, or when a request for updated information 
is received from each monitor, as disclosed and claimed in the present application. 
Further, nowhere does the Kawai '746 patent disclose or suggest an operation in which the 
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display image itself is transmitted to each of the at least one monitor, as disclosed and 
claimed in the present application. 

For the above reasons, Applicants submit that independent Claims 1, 8, 15, 
30 to 32 and 34 to 36 are allowable over the cited art. 

Claims 2 to 7 to 9 to 14 and 16 to 24 depend from Claims 1, 8 and 15, 
respectively, and are believed allowable for the same reasons. Moreover, each of these 
dependent claims recites additional features in combination with the features of its 
respective base claim, and is believed allowable in its own right. Lidividual consideration 
of the dependent claims respectfully is requested. 

In formal matters, submitted herewith is a substitute specification, together 
with a marked-up version showing amendments to correct matters of form, including 
English spelling, grammar, idiom, syntax and the like. No new matter has been added. 

AppHcants believe that the present Amendment is responsive to each of the 
points raised by the Examiner in the Official Action, and submit that the application is in 
allowable form. Favorable consideration of the claims and passage to issue of the present 
application at the Examiner*s earliest convenience eamestly are solicited. 

Applicants' undersigned attorney may be reached in our Washington, D.C. 
office by telephone at (202) 530-1010. All correspondence should continue to be directed 



to our below listed address. 




FITZPATRICK, CELLA, HARPER & SCINTO 
30 Rockefeller Plaza 
New York, New York 101 12-3801 
Facsimile: (212)218-2200 

CPW\gmc 

DC^MAIN 165142V1 
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TITLE 

COMMUNICATION APPARATUS, STORAGE MEDIUM, CAMERA AND 

PROCESSING METHOD 

5 . 

(Substitute Specification for Appln. No. 09/480,861 - Marked up Version) 
BACKGROUND OF THE INVENTION 

10 

Field of the Invention 

The present invention relates to a communication apparatus, a storage 
medium, a camera and a processing method. 

15 

Related Background Art 

A One video transmission system has been proposed in whic h , hi this 
system , for example, plural video cameras and computers are located inside a 
building, and these video cameras and the computers are networked through 
20 communication lines, thereby realizing video transmission among plural desired 
points and interactive communication by video and audio. 
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In this such th e video transmission system, a user of the computer at one 
point (local computer) can remote-control the video camera at a the desired remote 
point and display the video taken by the remote-controlled video camera on the 
screen of the user's local own computer. 
5 Further, in a the video transmission system capable of remote-controlling 

a remote the video camera, especially, as the number of the video cameras to be 
remote-controlled increases, it is necessary for the user to easily understand where 
each video camera is located. Thus, a the technique which superimposes a camera 
symbol representing the location of each video camera on an image representing a 

10 map has been proposed. Further, a the technique which represents the direction of 
picture taking of the actual video camera by displaying the direction/orientation 
di re ction of the camera symbol has been proposed. 

Li the above system, there is a case where a the video camera which is 
represented by a the camera symbol superimposed on the map is operated and 

15 controlled by a user at a remote location. In this case, as long as the terminal 
which utilizes that map does not obtain a the state update of the video camera 
concemed, a the problem exists in that the state of the camera symbol does is not 
correspond co rr esponding to the state of the actual video camera is caused . 

20 SUMMARY OF THE INVENTION 

An object of the present invention is to provide a communication 
apparatus, a storage medium, a camera and a processing method which can 
unitarily control information concerning video cameras and transmit such the 
information to all terminals operating the video cameras. 
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As one preferred example of the present invention, there is provided a 
communication apparatus which is connected to at least one camera and at least 
one monitor and manages information concerning a state of the at least one camera, 
comprising: 

5 reception means for receiving the information concerning the state of the 

at least one camera; and 

transmission means for transmitting the information conceming the state 
of the at least one camera received by the reception means to the at least one 
monitor, so as to change a display conceming the state of the at least one camera 
10 displayed on the at least one monitor. 

wherein the transmission means transmits the information in 
correspondence with the change of the state of the at least one camera. 

Another object of the present invention is to provide a communication 
apparatus, a communication method, a camera and a processing method each of 
1 5 which has a new function. 

Other objects and features of the present invention will become apparent 
from the following detailed description and the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
20 Fig. 1 is a block diagram showing the overall e nti re structure of a 

communication system including a video communication system according to one 
embodiment of the present invention; 
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Fig. 2 is a block diagram showing the structure of main software of a 
video transmitter 20 and a monitor 60 according to one embodiment of the present 
invention; 

Fig. 3 is a view showing a display example of the monitor according to 
5 one embodiment of the present invention; 

Fig. 4 is a view showing a display example of the monitor according to 
one embodiment of the present invention; 

Fig. 5 is a view showing a display example of a window for displaying 
video from a video camera, according to one embodiment of the present invention; 
10 Fig. 6 is a view showing the state when display is performed by a 

drag-and-drop operation, according to one embodiment of the present invention; 

Fig. 7 is a view showing a mouse cursor of a video camera used in the 
drag-and-drop operation according to one embodiment of the present invention; 
Fig. 8 is a view showing the state when a display area by the 
15 drag-and-drop operation is changed, according to one embodiment of the present 
invention; 

Fig. 9 is a view showing a camera icon representing, that taken video is 
being displayed, according to one embodiment of the present invention; 

Fig. 10 is a view showing the state of an operation to stop a the display by 
20 the drag-and-drop operation according to one embodiment of the present invention; 

Fig. 1 1 is a view showing a display example of the monitor according to 
one embodiment (fourth embodiment) of the present invention; 

Fig. 12 is a flow chart showing an operation of map management software 
according to one embodiment (first embodiment) of the present invention; 
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Fig. 13 is a flow chart showing the operation of map management 
software according to one embodiment (first embodiment) of the present invention; 

Fig, 14 is a flow chart showing an operation of video reception software 
according to one embodiment (first embodiment) of the present invention; 
5 Fig. 15 is a flow chart showing the operation of video reception software 

according to one embodiment (first embodiment) of the present invention; 

Fig. 16 is a flow chart showing the operation of video reception soflrware 
according to one embodiment (first embodiment) of the present invention; 

Fig. 17 is a flow chart showing the operation of video reception software 
1 0 according to one embodiment (first embodiment) of the present invention; 

Fig. 1 8 is a flow chart showing the operation of video reception software 
according to one embodiment (first embodiment) of the present invention; 

Fig. 19 is a flow chart showing the operation of video reception software 
according to one embodiment (first embodiment) of the present invention; 
1 5 Fig. 20 is a flow chart showing the operation of video reception software 

according to one embodiment (first embodiment) of the present invention; 

Fig. 21 is a flow chart showing an operation of camera control client 
software according to one embodiment (first embodiment) of the present invention; 

Fig. 22 is a flow chart showing the operation of camera control client 
20 software according to one embodiment (first embodiment) of the present invention; 

Fig. 23 is a flow chart showing an operation of video transmission 
software according to one embodiment (first embodiment) of the present invention; 

Fig. 24 is a flow chart showing an operation of camera control server 
software according to one embodiment (first embodiment) of the present invention; 
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Fig. 25 is a flow chart showing the operation of camera control server 
software according to one embodiment (first embodiment) of the present invention; 

Fig. 26 is a flow chart showing an operation of a map management server 
software according to one embodiment (first embodiment) of the present invention; 
5 Fig. 27 is a flow chart showing the operation of the map management 

server software according to one embodiment (first embodiment) of the present 
invention; 

Fig. 28 is a flow chart showing an operation of map management server 
software according to one embodiment (second embodiment) of the present 
10 invention; 

Fig. 29 is a flow chart showing the operation of map management server 
software according to one embodiment (second embodiment) of the present 
invention; 

Fig. 30 is a flow chart showing an operation of video reception software 
15 according to one embodiment (third embodiment) of the present invention; 

Fig. 31 is a flow chart showing an operation of a map management server 
soflAvare according to one embodiment (third embodiment) of the present 
invention; 

Fig. 32 is a flow chart showing the operation of the map management 
20 server software according to one embodiment (third embodiment) of the present 
invention; 

Fig. 33 is a flow chart showing an operation of map management software 
according to one embodiment (fourth embodiment) of the present invention; 
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Fig. 34 is a flow chart showing the operation of map management 
software according to one embodiment (fourth embodiment) of the present 
invention; 

Fig. 35 is a flow chart showing an operation of a map management server 
5 soflrware according to one embodiment (fourth embodiment) of the present 
invention; 

Fig. 36 is a flow chart showing an operation of camera control server 
software according to one embodiment (fifth embodiment) of the present 
invention; 

10 Fig. 37 is a flow chart showing an operation of a map management server 

software according to one embodiment (fifth embodiment) of the present 
invention; and 

Fig. 38 is a flow chart showing the operation of the map management 
server software according to one embodiment (fifth embodiment) of the present 
15 invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[First Embodiment] 

Fig. 1 is a block diagram showing the overall entire structure of a 
20 communication system including a video communication system according to one 
embodiment of the present invention. 

In Fig. 1, numeral 10 denotes a video camera which generates video (or an 
image signal) on the basis of a taken (captured) image. Numeral 20 denotes a 
video transmitter such as a work station (WS), a personal computer (PC) or the like 
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which transmits the image signal from the video camera 10 to a monitor 60 and 
receives a control signal from the monitor 60 to control the video camera 10. 
Numeral 60 denotes a monitor, the monitor such as a the WS, a the PC or the like. 
Hkc which receives an the image signal from the video transmitter 20 and transmits 
5 a the control signal to the video transmitter 20 to control the video camera 10. 

Plural The plural video transmitters 20 and the plural monitors 60 can 
communicate with each other others through a network 100. Preferably, the video 
transmitter analog-to-digital (A/D) converts the image signal from the video 
camera 10 into digital image data, compresses the obtained digital image data, and 

10 transmits the compressed data to the monitor 60 through the network 1 00. 

Numeral 12 denotes a camera control circuit which controls panning, 
tilting, zooming, focusing and iris stopping irising operations in accordance with a 
fee control signal (i.e., a control code) from the video transmitter 20. The control 
signal is input via from an input/output interface (I/O) 32 of the video transmitter 

15 20 to the camera control circuit 12 on the basis of, e.g., an RS-232C standard or the 
like. 

If a the video camera 10 does not perform pcrfomis the panning, tilting, 
zooming, focusing and iris stopping irising operations, a the camera control circuit 
12 is not always necessary. However, it is preferable to control at least an ON/OFF 
20 fixnction of the power supply of the video camera 10. 
(Video Transmitter 20) 

Next, the structure of the video transmitter 20 will be explained. Numeral 
24 denotes a main memory, and numeral 26 denotes a storage unit such as a hard 
disk or the like. Numeral 28 denotes a mouse which acts as a pointing device. 
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However, other devices such as a touch panel on a bit map display 35 and the hke 
may be also used. Numeral 30 denotes a keyboard which acts as input means. 
Numeral 25 denotes an external memory from which a storage medium such as a 
floppy disk, a CD-ROM or the like is detachable. Numeral 32 denotes an the I/O 
5 which is connected to the camera control circuit 12 to transmit and receive a the 
control signal of the video camera 10. Numeral 34 denotes a video capture board 
which captures a video output signal VD of the video camera 10. The video output 
signal VD may be an analog signal such as a general NTSC (National Television 
System Committee) signal or a digital signal. If the signal VD is ^ the analog 

10 signal, it is necessary for the video capture board 34 to have has an AID conversion 
function. Numeral 36 denotes a video board which obtains the video captured by 
the video capture board 34 through a system bus 39 and displays the obtained video 
at an arbitrary location on the bit map display 35, Numeral 38 denotes a network 
interface (I/F) which communicates with the monitor 60 through the network 100. 

1 5 The above imits are connected to each other others through the system bus 39, and 
a CPU 22 controls the video transmitter 20 as a whole and the display of the bit 
map display 35 in accordance with software stored in the storage medium or the 
storage unit 26 or software obtained through the network 1 00. 

If the video capture board 34 does not have a data compression function, 

20 it is possible to provide software for realizing such a the function, whereby the 
CPU 22 can perform data compression processing. 

Using a By such the video transmitter 20 as structured above, the image 
data taken by the video camera 10 is transmitted to the monitor 60 at a remote 
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location through the network 100, and a the video camera 10 is controlled 
according to a the control code received from the monitor 60. 
(Monitor 60) 

Next, the structure of a the monitor 60 will be explained. It should be 
5 noted that, in the monitor 60, explanation of the devices or the imits which are 
the same as those in the video transmitter 20 (designated by like or similar 
reference numerals) will be omitted. A network I/F 138 receives the compressed 
image data from the video transmitter 20. A CPU 122 decompresses the received 
data (i.e., encoded data) by using a video compression decoder 33, and controls a 

10 video board 136 on the basis of the decompressed image data to cause a bit map 
display 135 to display the image taken by the video camera 10 and the state of the 
video camera 10. Further, the CPU 122 transmits a the control code to the video 
transmitter 20^ 20 for controlling the video camera 10, in accordance with data 
input by the user of the monitor 60 using with us e of a keyboard 130 or a mouse 

15 128. 

Next, the software of the video transmitter 20 and the monitor 60 
according to the present embodiment will be explained. It should be noted that the 
software explained hereinafter is executed by the hardware of the video transmitter 
20 or the monitor 60. 

20 Fig. 2 is a block diagram showing the structure of the main software of the 

video transmitter 20 and the monitor 60 according to one embodiment of the 
present invention. 

First, the software to be executed by the monitor 60 will be explained. 
Numeral 411 denotes camera control client software which is provided to remote 
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control a ihc video camera 10 connected to a the video transmitter 20. Numeral 

412 denotes video reception software which is provided to decompress the 
compressed image data transmitted from a the video transmitter 20 in the form of 
packets packet and to display the decompressed image data. Further, the video 

5 reception software 412 is provided to manage image data received from all of the 
plural video transmitters 20 (i.e., the video cameras 10) connected to the network 
100. Using By the video reception software 412, a camera ID of each video 
camera, a host computer ID of the video transmitter 20 to which the video camera 
concerned is connected, the information concerning the camera operation states 

10 such as the panning, tilting, zooming, focusing and iris stopping irising operations, 
tite information conceming whether or not the video camera concemed is 
controllable (accessible) , the state information conceming which video camera is 
currently is being controlled, and the state information conceming which video 
camera is ciurently is being displayed, displayed are stored in into the monitor 60. 

15 Also, Also the camera control client software 41 1 and map management software 

413 share such the information, whereby the information is utilized to effect 
camera symbol change or the like. Numeral 413 denotes the map management 
software, softwa re which uses a GUI (graphical user interface) function. The GUI 
function is provided to graphically display the location, the panning state and the 

20 tilting state of a the video camera 10 and to control the operation of the camera 10, 
using by a map, the camera symbol and a later-described scope display of Fig. 6. 
The above software is prestored into the storage unit of the monitor 60. 

Next, the software to be executed by the video transmitter 20 will be 
explained. Numeral 421 denotes camera control server software which is provided 
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to control ttrc panning, tilting, zooming, focusing and iris stopping irising 
operations of a the video camera 10 connected to a ttrc video transmitter 20^ 26 and 
also to capture the image data output from the video camera 10 to the video 
transmitter 20. Numeral 422 denotes video transmission software which 
5 cooperates with the camera control server software 421 and is provided to transmit 
the video to the monitor 60 currently controlling the video camera 10. The above 
software is prestpred into the storage unit of the video transmitter 20. 

Numeral 431 denotes map management server software which is provided 
to imitarily manage the states of all the video cameras of the plural video 
10 transmitters 20^ 20 and to update map information. It should be noted that one map 
management server software 43 1 is executed in one system. Fig. 2 shows that the 
map management server software 431 is executed in a titc video transmitter 20. 
However, the map management server software 43 1 may be executed in a the 
monitor 60^ 60 or in another computer connected to the network 100. In this case, 
1 5 the network address of the computer which executes the map management server 
software 431 is stored in all of the monitors 60 and the video transmitters 20 
connected via the network . 

The map management server software 43 1 communicates with the video 
reception software of the monitor 60 and the camera control server software 421 of 
20 the video transmitter 20, to update the map information of the system. 

Needless It is needless to say that, in addition to the above software, 
software for controlling two-way communication through the network 100, 
software for controlling the storage units 26 and 126, software for controlling the 
extemal memories 25 and 125, and the like are provided prcpai - cd in the system. 
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(User Interface) 

Next, a the user interface in the present embodiment, i.e., a screen which 
is displayed on the bit map display 135, will be explained. To simphfy the 
explanation, the user interface will be explained on the premise that one monitor 
5 60 is connected to the video transmitter 20 through the network. 

Figs. 3 and 4 are views showing a display example of the monitor 
according to one embodiment of the present invention. Concretely, Figs. 3 and 4 
show one example of the screen displayed on the bit map display 135 of the 
monitor 60. In Fig. 3, numeral 500 denotes a map window in which the map is 
10 displayed. In the present embodiment, plural maps 510, 520, 530 and 540 

showing layouts of offices, establishments (or stores), warehouses and the like are 
managed within the map window 500. Each Since e ach map is provided added 
with a map tab: tair; if the map tab is clicked by the mouse 128, the map provided 
added with the clicked tab is displayed up-front (as a map display area 502). At 
15 this time, the camera symbols are displayed on the up-front map. 

Fig. 3 shows the state that the map 520 is selected from among the maps 
510 to 540 and displayed on the map display area 502. On the map 510, video 
camera symbols (or video camera icons) 521, 522, 523 and 524 are displayed as 
icorts. At this time, if the map tab of the map 530 is clicked, the rnap 530 will be 
20 displayed, is displayed as shown in Fig. 4. 

In Fig. 4, the map 530 is displayed on the map display area 502, and video 
camera symbols (or video camera icons) 531 and 532 are displayed on the map 
530. 
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Fig. 5 is a view showing a display example of a window for displaying the 
video (or the image) from the video camera, according to one embodiment of the 
present invention. As shown in Fig. 5, in a window 600, the videos taken by the 
plural video cameras 10 are displayed on plural video display areas 610, 612, 

5 614, 616, 618 and 620, 620 respectively. Numeral 632 denotes a trash can icon 
which is used to delete (stop) the displayed video from a the video display area. 
Numeral 640 denotes a video camera control panel which includes camera control 
buttons for the video camera 10. It is possible by handling these buttons to control 
the panning, tilting, zooming, focusing and iris stopping irising operations of the 

10 video camera 10. 

In the present embodiment, the six areas are displayed by way of example. 
However, the present invention is not limited to this. Further, these areas may be 
commonlv displayed on the same screen as which is identical with the window 
shown in Fig. 3 or 4. 

15 Next, an outline of software operation of the video communication system 

according to the present embodiment (including the GUI) will be explained with 
reference to Figs. 6, 7, 8, 9 and 10. In the present embodiment, if a the camera icon 
on a the map 520, 530 or the like is dragged and dropped (i.e., a drag-and-drop 
operation) onto an the arbitrary video display area within the video display 

20 window, then the motion video transmitted from the video came r a corresponding 
video camera rcorresponding to the one dragged and dropped) diuppcd icon is 
displayed on the video display area onto which the camera icon is dropped. 

Fig. 6 is a the view showing the state when the display is performed by the 
drag-and-drop operation, according to one embodiment of the present invention. 
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Concretely, Fig. 6 shows the state that video camera icon 523 is dragged and 
dropped onto the video display area 614. An area 580 represents a video-taking 
range of the camera 523 . If the mouse cursor is located within m the range 580 and 
the range 580 is changed from the solid-line range to a dotted-line range, a camera 
5 zooming operation is performed changed , whereby the video-taking range can be 
changed. Similarly, tire panning and tilting operations can be performed by 
managing the area 580, Fig. 7 is a the view showing a the mouse cursor of the 
video camera used in the drag-and-drop operation according to one embodiment of 
the present invention. Fig. 8 is the view showing the state when the location of a 

1 0 display area is changed from window 614 to window 612 by the drag-and-drop 
operation is changed , according to one embodiment of the present invention. Fig. 
9 is a the view showing a the camera icon representing that the taken video is being 
displayed, according to one embodiment of the present invention. Fig. 10 is a the 
view showing the state of an the operation to stop the display of video in a window 

15 614 by a the drag-and-drop operation according to one embodiment of the present 
iiivention. 

In the present embodiment, during a the drag-and-drop operation, the 
shape of the mouse cursor is represented as a camera shown in Fig. 7, whereby the 
user can confirm that the drag-and-drop operation is being performed. At this time, 
20 on the basis of the location information of the dragged camera, the map 

management software 413 searches for the ID number of the camera concerned, 
and notifies the video reception software .4 12 of the ID of the dragged and dropped 
camera. On the basis of the notified ID, the video reception software 412 searches 
for the panning and tilting of the camera, the camera name and the name of the host 
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computer to which the camera is connected, and notifies the camera control chent 
software 411 and the map management software 413 of such information. 

The camera control client software 411 communicates with the camera 
control server software 421 of the video transmitter 20 to which the video camera 
5 10 is connected, through the network 100 in accordance with the notified 

information. Hereafter, the operation of the video camera 10 connected to the 
video transmitter 20 is controlled between the camera control client software 411 
of the monitor 60 and the camera control server software 421 of the video 
transmitter 20 concerned. The information conceming the panning operation, the 

10 tilting operation and the like of the camera (i.e., the information conceming the 
camera state) is notified from the camera control client software 41 1 to the video 
reception software 412 for a predetermined time or for each issuance of a camera 
control command. 

The map management software 413 updates the map stored in the video 

15 board 136, thereby changing the direction of the camera icon according to the 

direction of the actual video camera 10, drawing a scope 910 (Fig. 9) representing 
that the video (or the image) taken by the video camera 10 concemed is being 
displayed, and drawing a control pointer 920 (Fig. 9) within the scope 910 to 
control the panning, tilting and zooming operations of the camera. 

20 Further, the information conceming the panning operation, the tilting 

operation and the like of the camera is notified from the video reception software 
412 to the map management software 413 for a predetermined time or for each 
issuance of a the camera control command. Thus, if the panning state, the tilting 
state, the zooming state and the like of the camera are changed on the camera 
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control panel 640, such a the change is reflected on the displaying states of the 
camera icons 521, 522, 523, 524 and the like. 

If the camera control server software 421 starts, it commimicates with the 
map management server software 431 through the network 100. Hereafter, if the 
5 connection is requested fi-om the camera control client software 411, the camera 
control server software 421 performs predetermined connection processing. 

If the video display processing starts and a the connection between the 
camera control server software 421 and the camera control client software 41 1 is 
established, the camera control server software 421 notifies the map management 
1 0 server software of such a fact. 

Hereafter, until the camera control server software 421 is discormected 
fi-om the camera control client software 41 1, the camera control server software 
421 notifies the map management server software of "camera state information" 
every time the state of the video camera is changed or every time a certain time 
1 5 period, initially set by the camera control server software 42L 424- elapses. 

The camera state information includes a time (i.e., a time stamp) when the 
information is transmitted, attributes of the video camera (i.e., a panning value, a 
tilting value, a zooming value, etc.), the connection state to the camera control 
client software 41 1, a network address of the connected monitor terminal in which 
20 the camera control client software 411 is located , and the like. 

The map management server software 43 1 unitarily manages the camera 
state information transmitted from the entire video camera control server software 
421 running within the system. 
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Every time new camera state inforaiation is notified from a the camera 
control server software, or every time a certain time period initially set elapses, the 
map management server software 43 1 notifies all the monitors 60 running within 
the system of the camera state information of all the connected video transmitters 
5 20. The network address of the monitor 60 is notified to the map management 
server software 431 when the video reception software 412 starts operation. Also, 
the network address may be fixedly set in the map management server software 
43 1 or may be obtained based on the camera state information. 

The camera state information is actually received by the video reception 
10 software 412 and shared by the camera control client software 411 and the map 
management software 413. 

The camera state information from the map management server software 
431 is notified to the video reception software 412. Further, the information sent 
from the camera control client software 41 1 of the monitor 60 as a resuh of a the 
1 5 camera controlling operation is notified to the video reception software 412. 

In order to correctly manage this these information timewise, the camera 
state information is time-stamp managed for each video camera in this system. 
When the camera state information is notified by the video reception software 412, 
the time stamp of each camera is compared with the previous information. If the 
20 time stamp is newer than the previous one, the time stamp is updated, while if the 
time stamp is older than the previous one, the time stamp is discarded. 

After the camera state information is updated as above, the video 
reception software 412 notifies the map management software 413 of such a fact. 
The map management software 413 changes and updates the camera symbol on the 
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map on the basis of that information. In this case, the change of the display 
represents changes of photographing range and zooming (i.e., the area 580) shown 
in Fig. 6. 

In Fig. 2, the map management server software 43 1 is illustrated to be 
5 executed in a the specific video transmitter 20. However, the map management 
server software 431 may be executed in any of an arbitrary video transmitter, an 
arbitrary monitor or another computer connected to the id e ntical network. 

The actual image data is transmitted from the video transmitter 20 in 
accordance with the request from the video reception software 412 of the monitor 

10 60. The video reception software 412 transmits a command to the video 

transmission software 422 of the video transmitter 20 to which the video camera 10 
concerned is connected, through the network 100. This command is to request data 
transmission of one frame. The video transmission software 422 receives the 
command, divides the captured latest frame data into packets, and then transmits 

15 these packets to the video reception software 412. The video reception software 
412 reconstructs rcstmctu r cs the image frame from the received packets, displays 
the reconstructed r e stmctu r cd image frame on the video display area, and again 
transmits a the video transmission request command. By repeating such operations 
at high speed, the video taken at a the remote location is transmitted and displayed 

20 through the network 1 00. Thus, the video taken by a remote the video camera 1 0 
remotely located is displayed on the bit map display 135 of a local the monitor 60. 

When the videos taken by rtic plural video cameras 10 are displayed on 
plural the screens, a the video transmission request command is issued, a the 
captured video is compressed, a the frame is divided into the packets, the divided 
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packets are transmitted to the network, the packets are received, the frame is 
reconstructed r estructu r ed , the compressed data is decompressed, and the 
decompressed video data is displayed in turn and repeatedly, for each of the video 
transmission software of the respective video transmitter 20 to which each camera 

5 is connected. 

The video taken by the video camera can be shifted by dragging and 
dropping the displayed video to the desired video display area, area as shown in 
Fig. 8. Fig. 8 shows the state that the video taken by the video camera icon 523 
and displayed on the video display area 614 is shifted to the video display area 612. 

10 At this time, the video reception software 412 clears the area 614, and changes ; 
intemal parameters such that the area 612 (i.e., the drag-and-drop destination) acts 
as the video display area of the video of the camera 10. Hereafter, the video taken 
by the video camera 10 concemed is displayed on the drag-and-drop destination. It 
should be noted that the logical network is not disconnected even by such the 

15 operation. Namely, as described later, the once-connected communication network 
is not disconnected until the video display area displaying the video is dragged and 
dropped into the trash can icon. 

The display of ttte video taken by the video camera 10 is stopped as 
shown in Fig. 10. Namely, the video display area on which the video intended to 

20 be deleted is being displayed is dragged and dropped into the trash can icon 632 
within the video display window. Fig. 10 shows the state after the display of the 
video of the video camera icon 523 on the video display area 614 is stopped. At 
this time, the video reception software 412 clears the area 614 to stop issuing the 
video transmission request command to the software 412 of the video transmitter 



-21 - 

20 connected till then. Further, the video reception software 412 notifies the 
camera control client software 411 and the map management software 413 of the 
fact that the display was stopped. 

The camera control client software 411 receives such the notification, 
5 disconnects th e network to the video transmitter 20 concemed from the network , 
and clears the corresponding video display area. Further, the map management 
software 413 eliminates the scope display from the icon 523 of the video camera 
concemed, and updates the map. 

Figs. 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 
10 30, 31, 32, 33, 34, 35, 36, 37 and 38 are flow charts showing the above-explained 
software processing. 

Hereinafter, the respective steps in the flow charts will be explained. 

In the flow charts, it should be noted that a the step boxed by dotted lines 
represents the processing by which some communications are performed to another 
15 software. 

One software is executed in parallel with another software by the fimction 
of an operating system (OS). Further, there is a possibility that CPU resources are 
allocated to another software while one software is being executed. 

20 (Map Management Software: Figs. 12 and 13) 

In steps SlOO and S 102, the map management software 413 shovra in Fig. 
2 starts operation, and, for example, the map window 500 shown in Fig. 3 is 
displayed on the bit map display 135. 
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Steps SI 10, S112 and SI 14 represent the processing when that the camera 
symbol (e.g., the video camera icon 521 of Fig. 3) on the window 500 is chcked. 
If the video of the video camera represented by this camera symbol has been 
displayed on the video window (e.g., the video display area 610 of Fig. 5), the map 
5 management software 413 notifies the video reception software of focus change 
(i.e., change of the target to be controlled). This processing will be explained later 
intrra step S285. 

Steps SI 20, SI 22, SI 24, SI 25 and SI 26 represent the processing when 
tttat the camera symbol (e.g., the video camera icon 521 of Fig. 3) on the map 
10 window is dragged. While the symbol is being dragged, the shape of the mouse 
cursor is changed, changed as shown in Fig. 7. Then, Then the shape of the mouse 
cursor is restored when if the cursor is dropped. 

When if the 'mouse cursor is dropped into a tttc video window, the map 
management software 413 notifies the video reception software of the drop 
1 5 operation. This processing will be explained later in a step S260. 

In steps S130 and S132, when if the map tab of a the map (e.g., the map 
510, 520 or 530 of Fig. 6) is clicked, the map is changed to the map having the 
clicked map tab, and the display of the map and the camera symbols is updated. 

Steps S140, S150 and S152 represent the processing which is performed 
20 when a the focus change (i.e., a tfrc change of the target to be controlled) is notified 
fi-om the video reception software by clicking the video on the video window in 
later-described steps S234, S256 and S267. 
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Then, Then the map is changed such that a the camera symbol 
corresponding to a the focused video is displayed at the center of the map window, 
and the camera symbol is displayed. 

If a the camera state is notified from the video reception software in 
5 later-described steps S257, S268, S296 and S314, the state display of the camera 
symbol is updated according to the camera state information. 

In steps SI 60, SI 62 and SI 72, when if the end menu on the map window 
displayed by a predetermined operation is clicked, the map management software 
413 notifies the video reception software of the end, and the map management 
10 software ends. 

Steps SI 80, SI 82 and SI 84 represent the processing which is performed 
when the video camera is controlled by dragging the map symbol (e.g., the control 
pointer 920 of Fig. 9) with the mouse. The map management software 413 updates 
the display state of the camera symbol concerned, and notifies the video reception 
1 5 software to control the corresponding video camera. 

(Video Reception Software: Figs. 14 to 20) 

In step a ste p S200, the video reception software 412 starts operation, and 
the video window (i.e., the window 600) is displayed on the bit map display 135. 
20 In steps S210, S212 and S214, the video reception software 412 is 

connected to the predetermined map management server software and starts 
communication. In this case, an intemal flag is set to ON on if the video reception 
software 412 succeeds in connecting with the map management server software. 
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while the internal flag is set to OFF off if the video reception software 412 fails to 
make a connection m. 

In steps S220, S222, S224, S226 and S228, if the map management 
software 413 ends due to the trrtfac processing in the steps SI 60, SI 62 and SI 72, 
5 the video reception software 412 stops displaying the video and disconnects the 
video transmission software. Then. Then the map management software 413 
notifies the camera control client software to disconnect the camera control server 
software, and the video reception software ends. 

In steps S230, S232 and S234, if the displayed video (e.g., the video of the 
10 display area 614 of Fig. 6) is cUcked, the focus (the target to be controlled) is 

changed to the chcked video, ^ the video reception software 412 notifies the map 
management software and the camera control cHent software of focus change (i.e., 
change ofthe target to be controlled). Therefore, the map management software 
performs the processing in the step SI 40, and the camera control client software 
15 performs the processing in the step S420 (see below). 

Steps S240, S241, S242, S244, S246, S247, S248, S250, S251, S252, 
S253, S254, S255, S256, S257, S258 and S259 represent the processing which is 
performed when the displayed video (e.g., the video ofthe display area 614 of Fig. 
• 8) is dragged to the display area 612, or when the displayed video (i.e., the video of 
20 the display area 614 of Fig. 10) is dragged to the display area 632 (trash can). 

If the video is dropped into the trash can icon, the display ofthe dropped 
video is stopped, and the commimication with the camera from which the video 
was being is transmitted ends (Fig. 15). If the video is dropped into another video 
display window in which there is no video is being displayed , the video is shifted 
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to this video display window (i.e., the drop destination window) destination) 
window . On the other hand, if there is a the video being displayed in this drop 
destination window, the communication with the camera which transmits the video 
to this drop destination window ends, and the dragged/ dropped video display is 
shifted to this video display window (i.e., the drop destination window; see 
dcsliucitioii) window (F ig. 16). 

Steps S260, S261, S262, S263, S264, S265, S266, S267 and S268 
represent the processing which is performed when, e.g., the video camera icon 523 
is dropped into the video display area 6]A, 6i4 as shown in Fig. 6. 

If there is the video being displayed in the display area of the drop 
destination, the communication with the video camera which transmits this video 
ends. Thus, the video which is transmitted from the terminal corresponding to the 
video camera icon 523 is displayed in the display area of the drop destination (Fig. 
17). 

Steps S270 and S272 represent tiic processing which is performed when 
the video information is updated in the case where video is being there is the 
displayed video , after the processing in the steps S260 to S268. In this the 
processing, the video is requested to the video transmission software at 
predetermined timing. Then. Then the video transmission software performs the 
processing in accordance with u uiresponding to a later-described S530. 

Steps S275 and 8276 represent the processing which is performed when 
the video information is transmitted fi-om the video transmission software. 
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Steps S280 and S282 represent the processing which is performed when 
the camera symbol on the map management software is mouse-operated ( steps step 
S180 toS184). 

The video reception software notifies the camera control client software to 
5 control the video camera which is currently being focused (i.e., b e ing the target to 
be controlled). Thus. Thus the camera control client software performs the 
corresponding processing in a later-described step S430. 

Steps S285, S286 and S287 represent the processing which is performed 
when the camera symbol on the map management software is clicked by the mouse 
10 (steps SI 10 to SI 14). 

The video reception software notifies the camera control client software to 
change the focus (i.e., the target to be controlled) of the camera corresponding to 
the camera symbol. Thus, Thus the carhera control client software performs the 
processing in a later-described step S420. 
15 Steps S290, S292, S294, S295 and S296 represent the processing which is 

performed when the camera state is notified from the map management software or 
the camera control client software. 

The camera state information of the overall entire camera control server 
software connected is transmitted from the map management server software, at a 
20 the timing when the new information is transmitted from the camera control server 
software and the camera state information is updated. 

A camera control instruction is transmitted from the camera control client 
software to the camera control server software every time the video camera is 
controlled. 
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The camera state information transmitted to the video reception software 
is subjected to old and new judgment by using the time stamp for each video 
camera. The camera state information is updated if it is new, while the camera 
state information is discarded if it is old. 
5 The updated camera state information is notified to the map management 

software and processed in the step SI 50. 

In step trstcp S300, if the connected video transmission software ends due 
to by the processing of later-described steps S510 to S514, the video transmission 
soflware concemed is discormected. 
10 In steps S3 10, S3 12 and S3 14, if the camera control server software to 

which the camera control client software is connected ends due to by the 
processing of later-described steps S410 to S412, the video transmission software 
of the video transmitter 20 to which the camera control server software is 
cormected is disconnected. 
15 In steps S3 1 5 and S3 1 6, if the connected map management server 

software ends, the cormection flag to the map management server software is 
tumed OFF off, and the map management server software is disconnected. 

In step trstcp S320, the connection flag to the map management server 
software is checked, and reconnection processing is performed if the map 
20 management server software is not connected. 

This is the processing prevents which is to p r event restart of the entire 
system when the map management server software is temporarily stopped for some 
reasons and then restarted. 




(Camera Control Client Software: Figs. 21 and 22) 

In step a-stcp S400, the camera control client software 411 starts 
operation, and the camera control window (e.g., the video camera control panel 
640) is displayed on the bit map display 135. 
5 In steps S410 and S412, if the video reception software ends due to by the 

processing in tire steps S220 to S228, or if the camera control server software ends 
due to by the processing in the steps S620 to S622, the camera control client 
software disconnects the camera control server software, whereby the camera 
control client software ends. 
10 In steps S420 and S422, if a the focus change is notified by the processing 

in the steps S234, S267 and S287, the camera control client software checks 
whether or not the focused video camera is currently controllable faccessible) . If 
controllable, for example, the control button on the video camera control panel 640 
is made available. 

15 In steps S430, S432 and S435, if the camera control is notified fi-om the 

video reception software in the step S282, or if the control button is clicked, the 
camera control client software transmits the control command to the focused 
camera. 

Steps S440 and S442 represent the processing which is performed when 
20 the camera control server software returns to the video reception software the 
notification that a the control command from the camera control server software 
was received in step a step S642, by the processing in tiic steps S430 to S435. 
Namely, the camera state is notified to the video reception software. The video 
reception software processes the retumed notification in the step S295. 
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In steps S450, S452 and S454, the video reception software connects to 
the camera control cUent software corresponding to the camera symbol into which 
the video is dropped, in response to the notification in the step S266. After the 
connection, the camera control client software notifies the video reception software 
of the camera state. The video reception software processes this notification in the 
step S295. 

In steps S460, S462 and S464, the camera control chent software 
disconnects the focused camera control server software on the basis of the 
disconnection notification in fee steps S248, S254 and S264. After the 
disconnection, the camera state is notified to the video reception software. The . 
video reception software processes this notification in the step S295. 

(Video Transmission Software: Fig. 23) 

Steps S500, S510, S512, S514, S520, S522, S530, S532, S540 and S542 
1 5 represent fee operation of the video transmission software. 

Further, these steps represent in detail the processing flows of the video 
reception client software, the video reception software and the video display 
software. 

20 (Camera Control Server Software: Figs. 24 and 25) 

In step a step S600, the camera control server software starts operation. 

In steps S610, S612 and S615, the camera control server software 
connects to the predetermined map management server software and starts the 
communication. In this case, an internal flag is set to ON on if the camera control 
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server software succeeds in connecting with the map management server software, 
while the internal ftag is set to OFF off if the camera control server software 412 
fails to make a connection in. 

Steps S620, S622 and S624 represent the processing which is performed 
when the end menu is clicked by a the predetermined operation. 

The camera control server software notifies the map management server 
software, suftwai - e and the camera control client software in connection, of the end. 
Then the camera control server software ends. 

Steps S630 and S632 represent the processing which is performed when 
the camera control client software performs the connection processing in the step 
S452. 

Steps S640, S642, S644 and S646 represent the processing which is 
performed when a fte control instruction is issue,d from the camera control client 
software in the step S432. In this case, the video ride camera is controlled, and 
thus obtained camera information is notified to the camera control client software. 

If the connection to the map management server software has been 
established, the camera state information is notified also to the map management 
server software. 

Steps S650 and S652 represent the processing which is performed when 
the disconnection processing is performed by the camera control client software ir 
the step S462. 

Step S660 and S662 represent fee processing which is performed when 
the map management server software ends in later-described steps S710 to S714. 
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In this case, the connection ends, and the connection flag is turned OFF 

off. 

In steg a-stcp S670, the connection flag to the map management server 
software is checked, and reconnection processing is performed if the map 
5 management server software is not connected. 

This is the processing prevents which is to prevent restart of the entire 
system when the map management server software is temporarily stopped for some 
reasons and then restarted. 

10 (Map Management Server Software: Figs. 26 and 27) 

In step trstcp S700, the map management server software starts operation. 

hi steps 8710, S712 and S714, when if the displayed end menu is clicked 
by a the predetermined operation, the map management server software notifies the 
camera control server software, softwai ' c and the video reception software in 
1 5 connection, of the end. Then the map management server software ends. 

In steps S720, S722, S730 and S732, processing it waits for a the 
connection request fi-om the camera control server software and the video reception 
software. If the request is transmitted, the corresponding connection processing is 
performed. 

20 Steps S750, S752, S760 and S762 represent the processing which is 

performed when the disconnection requests are transmitted fi-om the camera 
control server software and the video reception software. Li this case, the 
corresponding disconnection processing is performed. 
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[Second Embodiment: Figs. 28 and 29] 

In the first embodiment, the camera state is notified to the video reception 
software at a the timing when the camera state is notified from the camera control 
server software. However, in the second embodiment, the camera state is notified 
to the video reception soflvv^are after a predetermined time period elapses. 

Figs. 28 and 29 are shows the flow charts showing the operation of the 
map management server software. It should be noted that the operations of other 
software in the second embodiment are substantially the same as those in the first 
embodiment. 

The changed parts (i.e., the parts different from those of the first 
embodiment) in the flow charts are as follows. 

In steps S740 and S742, if the camera state is notified from the camera 
control server software, the camera information of the video camera concerned is 
updated. 

In steps S770 and S772, when if the previously set (predetermined) time 
period elapses, the camera information of all the video cameras is notified to the 
video reception software of the plural monitors in connection. 

[Third Embodiment: Figs. 30, 31 and 32] 

In the first embodiment, the map management server software notifies the 
camera state to the video reception software. However, in the third embodiment, 
the video reception software inquires of the map management server software as to 
the camera state every time a predetermined time period elapses. 
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Fig. 30 shows the operation flow of the third embodiment which is 
different from that of the first embodiment. 

The changed parts (i.e., the parts different from those of the first 
embodiment) in the flow charts are as follows. It should be noted that the 
5 operations of other software in the third embodiment are substantially the same as 
those in the first embodiment. 

hi steps S290 and S291, instead of the processing in which that the 
camera state notification is checked from the map management server software, a 
the map state request is notified to the map management server software every time 
10 a the predetermined time period elapses, and the video reception software waits 
until the camera state is notified. It should be noted that the processing after the 
camera state is notified is the same as that in the first embodiment. 

Figs. 31 and 32 show the operation flow of the map management server 
software. 

1 5 The changed parts (i.e., the parts different from those of the first 

embodiment) in the flow charts are as follows. It should be noted that the 
operations of other software in the third embodiment are substantially the same as 
those in the first embodiment. 

In steps S740 and S742, if the camera state is notified from the camera 

20 control server software, the camera information of the video camera concerned is 
updated. At this timing, the camera state is not notified to the video reception 
software in connection. 

In steps S770 and S772, if a the camera state request is notified from the 
video reception software, the camera state is notified to the video reception 
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software concerned. Unlike the first embodiment, such the camera state is not 
notified simultaneously to all the video reception terminals connected to the map 
management server software. 

5 [Fourth Embodiment: Figs. 33, 34 and 35] 

In the first to third embodiments, the file which represents the structure of 
the map itself is called a "map file", file" in which the bit map images, images such 
as the map and the camera symbols, the locations of the camera symbols on the 
map, the kinds of video cameras and the like have been written, written is held in 
10 each map management software. 

However, in the fourth embodiment, the map management server software 
unitarily manages the map file. 

In By the fourth embodiment, in addition to the camera state when the 
system is operating, the bit map images of the map and the camera symbols, the 
15 locations of the camera symbols on the map are unitarily managed. Thus, the user 
can use the identical map at all the monitors accessing the identical map 
management server software. 

In the present embodiment, a communication capability to the map 
management server software is added to the map management software in the first 
20 embodiment, whereby the map management software of the monitor 60 can obtain 
the bit map images of the map and the camera symbols fi-om the map management 
server software of the video monitor 20. 

The changed parts (i.e., the parts different fi-om those of the first 
embodiment) in the flow charts are shown in Figs. 34 and 35. It should be noted 
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that the operations of other software in the fourth embodiment are substantially the 
same as those in the first embodiment on the premise that "camera information" 
(i.e., the camera information of all the video cameras) is replaced with "map file" 
information (i.e., the bit map images such as the map and the camera symbols, the 
5 locations 

of the camera symbols on the map, the kinds of video cameras, and the camera 

information of all the video cameras). 

However, if the bit map file is fi-equently copied, a the load is placed on 

given t o the processing. Therefore, the bit map file may be copied only at a the 
1 0 timing when the map management software starts and when an update button 590 

of Fig. 1 1 is clicked by the mouse. 

In stee a-stcp S 1 02, if the map management software starts, it connects to 

the map management server software and requests a the map file (i.e., the bit map 

images such as the map and the camera symbols, the locations of the camera 
1 5 symbols on the map, the kinds of video cameras, and the camera information of all 

the video cameras). Then the map management software receives the data, and 

displays the map and the camera symbols on the window in accordance with the 

received data. 

In steps SI 90 and SI 92, when the update button is clicked, the map 
20 management software connects to the map management server software, requests a 
the map file (i.e., the bit map images such as the map and the camera symbols, the 
locations of the camera symbols on the map, the kinds of video cameras, and the 
camera information of all the video cameras), and receives the data. Then the map 
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management software displays the map and the camera symbols on the window in 
accordance with the received data. 

By the above processing, in the case where the bit map images such as the 
map and the camera symbols, and the locations of the camera symbols on the map 
5 are changed while the map management software is running, it is possible to obtain 
the data after the change without restarting the system. 

In steps S770 and 772, if a the map file is requested from the map 
management software, the map file is transmitted, and the map management 
software is disconnected. 
10 By the above procedure, a the map file can be always maintained and 

updated unitarily, whereby the user can use the identical map at all the monitors 
accessing the identical map management server software. Also, the new camera 
information can be always displayed. 

In this case, although the present embodiment has been explained in the 
1 5 form of expansion of the system already explained in the first embodiment, the 
present embodiment is not limited to this. 

For example, the map management server software may be replaced with 
Web server software, the map management software may be replaced with Web 
browser software, and the video display client software or the camera control client 
20 software may be replaced with plug-in software or helper application. 

In this case, a Ac map file may be obtained from the Web server software 
every time an update button on Netscape Navigator or Internet Explorer is clicked, 
as shown in the third embodiment. 
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Further, by using a so-called server push method which transmits the data 
from the Web server software to the Web browser software without request from 
the Web browser, a tire map file transmitted as in the first and second embodiments 
may be received. 

5 

[Fifth Embodiment: Figs. 36, 37 and 38] 

In the ft)urth embodiment, the bit map images such as the map and the 
camera symbols and the locations of the camera symbols on the map are unitarily 
managed by the map management server software. 
1 0 When the actual camera disposing location and the initial direction of a 

pan head are changed, it is necessary to update the map file according to the 
change. However, the video camera is not always disposed at the location in the 
vicinity of the map management server softwareiifso, the user must move to the 
location of the map management server software and change the map file after the 
1 5 actual camera disposing location is changed. It seriously increases costs to do so, 
so both in time and operation. 

The fifth embodiment is directed to one example to solve such a problem. 
In the present embodiment, coordinates of the camera symbol on the map 
corresponding to the video camera concerned and an input unit for inputting the 
20 initial direction of the pan head are provided for the camera control server 
software. Further, the a communication unit for communicating the input 
information to the camera management server software is also provided. 

The changed parts (i.e., the parts different from those of the first 
embodiment) in the flow charts are shovm in Figs. 36 to 38. 
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In step a-stcp S602, when if the camera control server software starts, the 
coordinates of the camera symbol on the map connected to the video transmitter in 
which the camera control server software concemed is running and the initial 
direction of the pan head are read from the predetermined initial setting file. 

Li step trstcp S612, if the connection to the map management server 
software ends, the coordinates of the video camera on the map and the initial 
direction of the pan head are notified to the map management server software. 

The map management server software receives the data and updates the 

map file. 

Li step a step S724, if the connection to the camera control server software 
ends, the map file is updated according to the notified coordinates of the video 
camera on the map and the notified initial direction of the pan head. 

Step A step S754 represents titc processing which is performed when the 
camera control server software ends and the disconnection is notified. 

The disconnection processing is performed, the map file is updated, and 
the fact that the camera control server software is docs not running run is notified 
to the video reception software. 

The video reception software notifies the map management software of 
such lite information, and the map management software updates the map symbol. 

[Other Embodiments] 

The present invention is applicable to a system composed of plural pieces 
of equipment equipments (e.g., a host computer, an interface equipment, a reader, a 
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printer and the like) or to an apparatus including only a single piece of equipment 
(e.g., a copying machine, a facsimile machine or the like). 

Needless It is needless to sa v, an that the object of the present invention 
can be achieved in a case where a storage medium storing the program codes of of 
5 a software for realizing the functions of the above-described embodiments is 
supphed to a system or an apparatus, appai - atus and then a computer (or CPU or 
MPU) in the system or the apparatus reads and executes the program codes stored 
in the memory medium. 

In this case the program codes themselves read from the storage medium 
10 realize the. functions of the embodiments, and the storage medium storing such the 
program codes constitutes constitute the present invention. 

The storage medium storing the program codes can be, for example, a 
floppy disk, a hard disk, an optical disk, a magnetooptical disk, a CD-ROM, a 
CD-R, a magnetic tape, a non- volatile memory card, a ROM, or the like. 
15 The It is n e edless to say that the present invention also includes not only 

the case where the functions of the embodiments are realized by the execution of 
the program codes read by the computer, but also a case where an OS (operating 
system) or the like functioning on the computer executes all the process or a part 
thereof according to the instructions of the program codes, thereby realizing the 
20 functions of the embodiments. 

The Fui ' thcr, it is needless to say that the present invention further 
includes a case where the program codes read from the storage medium are first 
once stored in a memory provided in a function expansion board inserted into in 
the computer or a fimction expansion imit connected to the computer, and a CPU 
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or the like provided in the function expansion board or the function expansion unit 
executes all the process or a part thereof according to the instructions of such 
program codes, thereby realizing the functions of the embodiments. 

According to the above-explained embodiments, the information of the 
5 video camera and the map information in the vicinity of the location at which the 
video camera is disposed can be unitarily managed, and the managed information 
can be notified to all the terminals operating the video cameras timewise as 
accurately accui ' atc as possible. 

Further, in the communication apparatus which is connected to at least 
10 one camera and at least one monitor and manages tttc information concerning the 
state of the camera, there are provided the reception means for receiving the 
information concerning the state of the camera, and the transmission means for 
transmitting the information concerning the state of the camera received by the 
reception means to the monitor, so as to change a display conceming the state of 
15 the camera displayed on the monitor, whereby the state of the camera can be 
recognized at the monitor. 

Further, when the image data taken by the camera is received by the 
monitor, the states of the camera (i.e., the disposing location, the photographing 
range, the information of zooming) can be simultaneously grasped. 
20 Further, if the information conceming the state of the camera is 

transmitted according to the change of the state of the camera, the state of the 
camera can be quickly grasped. Further, since such the transmission is performed 
according to a the request from the monitor, the state of the camera can be grasped 
as necessary acco r ding to necessity , without redundant transmission. 
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Further, in a ttre communication apparatus which is connected to at least 
one camera and at least one monitor and manages the information concerning the 
state of the camera, there are provided the reception means for receiving the 
information concerning the state of the camera, the processing means for changing 
5 a the display image conceming the state of the camera displayed on the monitor, in 
accordance with tttc received information conceming the state of the camera, and 
the transmission means for transmitting the display image conceming the state of 
the camera processed by the processing means, to the monitor, whereby the display 
image conceming the state of the camera can be obtained at the monitor. 
10 Therefore, if tire information conceming the state of the camera is received at the 
monitor and a the display image is formed according to the received result, it is 
possible to prevent a need that the size of the monitor be increased inc re ases . 

As a result, for example, as the number of the monitors increases, it is 
possible to reduce the size of the overall e nti r e apparatus in the system including 
1 5 the cameras, the communication units and the monitors. 

Further, since the transmission is performed according to a tire request 
from the monitor, it is possible to limit the number of transmissions transmission 
of the data (i.e., the image) of which data quantity is large. 

Further, the transmission means is provided which transmits the 
20 information conceming the state of the camera to the monitor such that the 

information conceming the state of the camera is reflected on the map screen for 
controlling the camera displayed on the monitor. Thus, even if the camera is 
distant from the monitor, the state of the camera can be quickly reflected on the 
monitor. For this reason, for example, if the plural cameras are provided dispos e d . 
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the load to the operator can be reduced as compared with the case where the 
operator sets the state information of the plural cameras after he sets the plural 
cameras. Thus, it is possible to prevent an the error in which that the state of the 
camera does not coincide with that of the monitor. 
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ABSTRACT OF THE DISCLOSURE 

In a system wherein one or more controllable camera(s) camera and one or 
of more monitor(s) monito r for displaying video information received from the 
camera(s) camera are connected to each other through a communication device, the 
states of all the cameras can be alw^ays understood at any monitor. Map Therefore, 
map management server software is provided to receive notification(s) 
notifications of camera state information by all the cameras with the predetermined 
device, and to transmit the camera state information to all the monitors. 
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